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ABSTRACT 



Let ||A|| P)g be the norm induced on the matrix A with n rows and m columns by the 
Holder £ p and l q norms on R n and R m (or C n and C m ), respectively. It is easy to find an 
upper bound for the ratio || A|| r)S /|| A|| Pj9 . In this paper we study the classes of matrices 
for which the upper bound is attained. We shall show that for fixed A, attainment of the 
bound depends only on the signs of r — p and s — q. Various criteria depending on these 
signs are obtained. For the special case p = q = 2, the set of all matrices for which the 
bound is attained is generated by means of singular value decompositions. 



1. INTRODUCTION 

Let A be a matrix with n rows and m columns. If A is considered as a complex 
transformation, let \i\ and ^2 be norms on C m , and let v\ and z/ 2 be norms on C n . If A 
is real and is considered as a transformation from R m to R n , let the \ii be norms on R m 
and the z/j be norms on R n . Define the induced norms 

|| A|| W =ma XI / i (ix)/ ft (x) 

for i = 1 and 2, where the maximum is taken over either C m or R m , as is appropriate. It 
was shown in [SS] (see also [HJ, p. 303]) that 

(1.1) ||A||( 2 )<max^ max ^44 WM (1 \ 

x f/ 2 ( x ) y zvi(y) 

and that equality is always attained for some A 7^ 0. Here the maxima are taken over C m 
and C n if A is thought of as a complex transformation, and over R m and R n if A is a real 
and its action is confined to R m . 

In this work we shall be concerned with characterizing the set of all matrices A for 
which equality is attained in (1.1), at least in some cases. 

We shall show that this set can be described by the following property. 

Theorem 1. If equality holds in the inequality (1-1), then every maximizer v of the 
ratio f 2 (Ax)///2(x) has the properties that 

(i) v is also a maximizer of the ratio ji\ (x)//Z2 (x) , 

(ii) Av is a maximizer of the ratio ^2(y)/^i(y), and 
(in) v is also a maximizer of the ratio fi(Ax)//xi(x). 

Conversely, if there is one maximizer v of v\ (Ax)///i (x) which has the properties (i) 
and (ii), then equality holds in (1.1). 

Theorem 1 can only provide useful information if the two maxima on the right and 
the corresponding maximizers are known. Both of these conditions apply when the norms 
involved are Holder norms. We denote the l v norm by || || p . For any p and q in the interval 
[1, 00] we define the induced norm 

||Ax|| 

(1.2) || AIL a := max — — 

v ' " up,q x xL 
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The maximum of the ratio ||x|| r /||x|| p and the corresponding maximizers are well 
known. In order to state the result we recall that sgn(z) is defined to be 1 if z > 0, if 
z = 0, and -1 if z < 0, and that [z]+ is defined to be z if z > and if z < 0. We also 
define the three subsets of a real or complex vector space of m-tuples or n-tuples. 

K\ = {x : all components of x have equal absolute values} 

(1.3) K-i = {x : at most one component of x differs from 0} 
Kq = the whole vector space. 

The following result is found, e.g., in [HLP, p. 26 #16 and p. 29#19]. 
Proposition 1. For any x in R m or C m 

(1.4) ||x|| r < m [( 1 /-)-(Vp)] + || x || p for Pj r e [ 1? ^ 

Equality holds if and only if the m-vector x lies in K sgn ( p _ r ^ . 

By inserting Proposition 1 into the inequality (1.1) and into Theorem 1, we immedi- 
ately obtain the following special case for the Holder spaces. 
Proposition 2. 

(1.5) \\A\\ ri8 < m [(1/p) - (1/r)] + n [(1/s) " (1/g)] + \\A\\ p , q for p, q,r,se [1, oo]. 

If equality holds in this inequality then every maximize! v of the ratio ||Ax|| s /||x|| r 
has the properties 

(i) v G -ftT_ sgn ( p _ r ), 

(ii) Av e K sgn{q _ s) , and 

(in) v is a maximizer of the ratio \\ Ax|| g /||x|| p . 

Conversely if there exists a maximizer v of the ratio ||Ax|| 9 /||x|| p which has the 
properties (i) and (ii), then equality holds in (1.5). 

For the case m = n, q = p, s = r, the inequality (1.5) was pointed out by Higham [H, 
p.124]. 

Remark. The inequality (1.5) is equivalent to the following monotonicity statement: For 
fixed s, ||A|| rs is nondecreasing and m 1 ' r ||-A|| T . jS is nonincreasing in r, and for fixed r, 
n _1 / s ||A|| r)S is nondecreasing and ||A|| r s is nonincreasing in s. 

The inequality (1.5) obviously implies the above statement. It is not difficult to show 
that the converse is true. If, for instance, p < r and q < s, then the monotonicity statement 
implies that 

m 1/r |Hlr, s < ™ 1/p Pllp )S < 
which implies the inequality (1.5) for this case. 

The trivial observation that for fixed (p, q) the only dependence on (r, s) in Proposition 
2 is through the functions sgn(p — r) and sgn(g — s) immediately yields the following 
statement. 

Proposition 3. If equality holds in (1.5) , if sgn(p — r')=sgn(p — r), and if sgn(q — 
s')=sgn{q — s), then equality also holds in (1.5) when the pair (r, s) is replaced by (r', s'). 
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Remark. By using the inequality (1.5) with r = p' and s = q' , one sees that 
Proposition 2 also shows that equality in (1.5) implies that 

\\A\\ r > ta > = m [(i/p')-(i/r')]+ n [(i/«')-(i/9')]+ \\A\\ p , !q ,, for p, q,r,sE [1, oo], 

provided sgn(p' — r') = sgn(p — p') = sgn(p — r) and sgn(q' — s') = sgn(q — q') = sgn(q — s). 

Proposition 3 shows that for a prescribed pair (p, q) with 1 < p, q < oo, equality holds 
in (1.5) for some r ^ p and s ^ q if and only if A lies in the appropriate one of at most 
four classes, which we shall label by the extremal pair (r, s), that is, the pair in which each 
of these indices has the value 1 or oo, for which equality holds in (1.5). That is, we define 

= {A : equality in (1.5) holds when r < p and s > q}, 
= {A : equality in (1.5) holds when r < p and s < q}, 
= {A : equality in (1.5) holds when r > p and s > q}, 
= {A : equality in (1.5) holds when r > p and s < q}. 

(Of course, when p and or q has one of the extreme values, some of these classes are trivial.) 
This work is concerned with characterizing the members of these four classes. 

When p = q = 2, Proposition 2 enables us to give a characterization of all matrices 
for which equality holds in the bound (1.5). As usual, we denote the Hermitian transpose 
of a matrix A by A*. 

Theorem 2. If r,s e [1, oo], the equality 

\\ A \\ rjS = m [(l/2)-d/r)] + n [(l/.)-(l/2)] + p|| 2j2 _ 

is valid if and only if A has a singular value decomposition 

A = UEV* 

in which 

(i) the first column of the unitary matrix U is in K sgn ( 2 - S ), 

(ii) the first column of the unitary matrix V is in K_ sgn ^ 2 - r ), and 

(in) the (11) entry of the nonnegative diagonal matrix E is its maximal entry. 

The first two theorems will be proved in Section 2. 

When p and q are not both 2, Proposition 2 will will be used to obtain characterizations 
of the classes in (1.6). Our most complete characterization is for the class £i j0 o(j>, o), which 
is treated in Section 3. 

Theorem 3. Let p denote the largest absolute value of the entries of A. 

Then ||^4||i )00 = p, and A e £i,oo(p> o) if and only if A has the properties 

(i) every entry of A which has the absolute value p is the only nonzero element of its row 
and of its column, and 

(ii) if C is the matrix obtained from A by replacing all elements of absolute value p by 
zero, then \\C\\ Pjq < p. 

If p > q, then A e £i,oo(p, q) if and only if A has at most one nonzero entry. 



(1.6) 



£i,i(p, q) 

£oo,oc(p, q) 
£r^ i (v. a) 
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Theorem 3' in Section 3 shows that the Property (i) is sufficient for the existence of a p > 1 
and a q < oo such that A e £i >00 (p, q). 

Section 4 deals with the cases in which r < p and s < q or r > p and s > q. We shall 
establish the following results. 

Theorem 4. Let <r denote the largest t\ norm of the columns of A, so that a = 

If A e £i,i(p, (?) then A has the properties 

(i) the entries of any column whose i\ norm is equal to a all have the same absolute value 
n~ 1 a, 

(ii) every column with this property is orthogonal to all the other columns of A, and 
(in) a = n 1 -^ || A\\ p , q . 

Conversely, if the matrix A has a column all of whose entries have the absolute values 
n-^WAW^q, then A e £ h i(p,q). 

If p > 2, then A e £i,i(p, q) if and only if A has only one nonzero column, and all the 
entries of this column have the same absolute value. 

Theorem 5. Let a denote the largest l\ norm of the rows of A, so that a = ||-A||oo,oo- 
If A E £oo,oo(f», q), then A has the properties 

(i) the entries of any row whose i\ norm is equal to a all have the same absolute value 
m~ 1 a, 

(ii) every row with this property is orthogonal to all the other rows of A, and 
(in) a = m 1 ^\\A\\^ q . 

Conversely, if the matrix A has a row all of whose entries have the absolute values 
m^/rt-ipH^ then A e £oo,oo(p, ?)• 

If q < 2, then A e £oo,oo(p, o) if and only if A has only one nonzero row, and all the 
entries of this row have the same absolute value. 

Theorem 4' in Section 4 shows that the Properties (i) and (ii) of Theorem 4 are 
sufficient for the existence of p > 1 and q > 1 such that A e £i,i(p, q)- Analogously, 
Theorem 5' states that the properties (i) and (ii) of Theorem 5 imply the existence of 
finite p and q such that A e £oo,oo(p, q) 

Section 5 considers the case where r > p and s < q. The following result is obtained. 

Theorem 6. A e £oo,i(j>, o) if and only if there is a vector v with the properties 

(i) v is an eigenvector of the matrix A* A, 

(ii) all the entries of v have the absolute value 1, 

(in) all the entries of Av have the same absolute value r, and 
(iv) t = m 1 / p n- 1 / q \\A\\ P!q . 

In particular, A e £<x>,i (2, 2) if and only if A* A has an eigenvector v with the properties 
(ii) and (in) which corresponds to its largest eigenvalue. 

We observe that when the matrix A is real, one has a choice of defining the induced 
norm with respect to either the real or the complex Holder spaces, and that these 

two norms may differ for some (p, q). Our results are valid for either choice. 

( 1 l\ 

Consider, for instance, the matrix A = I J . The last statement of Theorem 6 

with the complex eigenvector (1, i) of A* A = 21, shows that when r > 2 > s the norm 
||^4|| r ,s on the complex vector space C 2 is equal to 2 (1 / s )~( 1 / r ) + ( 1 / 2 ). On the other hand, a 
simple computation shows that on the real vector spaces, ||^4||oo,i = 2 while ||A|| 2 ,2 is still 
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2 1 / 2 . Thus in the real norm, equality does not hold in (1.5) when p = q = 2, r > 2, and 
s < 2. Therefore the real norm ||A|| r , s is strictly less than 2( 1//s )~( 1 / r ) + ( 1 / 2 ), and hence less 
than the complex norm, when r > 2 and s < 2. 



2. PROOFS OF THEOREMS 1 AND 2. 
We begin by proving Theorem 1. 

Proof of Theorem 1. We recall the derivation in [SS] of the inequality (1.1). For any 
with Ax ^ we have 



Because the maximum of a product of nonnegative numbers is bounded by the product of 
the maxima, we obtain the inequality (1.1). 

Suppose there is a maximizer of the left-hand side of (2.1), which is not a maximizer 
of one of the factors on the right. Since all the factors are bounded by their maxima and 
one of them is strictly less than its maximum, the right-hand side of (1.1) is strictly greater 
than the left-hand side. Therefore the condition of Proposition 1 is necessary for equality. 

If there is a maximizer v of all three quotients on the right of (2.1), then the maximum 
of the left-hand side is bounded below by the right-hand side of (1.1). Since we already 
know that it is bounded above by the same quantity, we conclude that equality holds in 
(1.1). This establishes Theorem 1. 

Proof of Theorem 2. We observe that a maximizer of the ratio || ^4v || 2/ 1| v || 2 is an 
eigenvector of the matrix A* A which corresponds to its largest eigenvalue. By Proposition 
2, equality in (1.5) with p = q = 2 implies that a maximizer v of || Ax^/Hx^ is such an 
eigenvector, that it is in K_ sgn ( 2 -r)i an d that the eigenvector Av of AA* is in i^ sgn (2-s)- 

Thus we can construct (see. e.g., the proof of Theorem 2.3-1 in [GVL]) a singular value 
decomposition A = U"EV* in which the first column of the unitary matrix U is the vector 
||Av||^ 1 Av G -Ksgn(2-s) an d the first row of the unitary matrix V is ||v||^" 1 v e K_ sgn ^ 2 -r)- 
The (11) element of the nonnegative diagonal matrix E is the square root of the largest 
eigenvalue of A* A, which is the maximal element of E. 

The converse follows from the fact that the first column of V is a maximizer of 
|| Ax|| 2 /||x||2 and the converse statement of Proposition 2, so that Theorem 2 is proved. 

Remark. If the matrix A is a scalar multiple of a unitary matrix and the absolute 
values of all its entries are equal to a number p, then A has a singular value decomposition 
with U = n~ 1 / 2 p~ 1 A, E = n l / 2 pl, and V = I, and another singular value decomposition 



with U = I, E = n x l 2 pl, and V = n l / 2 p X A* . Hence Theorem 2 shows that A lies in 
both £i,i(2,2) and £00,00(2,2). 



Examples of such matrices include the Hadamard matrices, which are orthogonal 
matrices whose entries have the values ±1 (see [H, p. 128, $6.13]), and the matrices which 
represent the finite Fourier transforms. 



(2.1) 



v 2 {Ax) _ £ii(x) v 2 (Ax) i^i (Ax) 
// 2 (x) fl2(x) ^i(Ax) ^ii(x) 



3. THE CLASS 



£1,00 (p, q). 
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The following lemma will be used in the proofs of Theorems 3, 4, and 6. We recall 
the definition of the conjugate index p* = p/(p — 1) of an index p, and the fact that A* 
denotes the Hermitian transpose of the matrix A. 

We also recall the identity 

(3-1) \\A*\\ q *, P * = \\A\\ M , 

which simply states that the norm of the adjoint of a transformation is equal to the norm 
of the transformation. 

Lemma 3.1. Suppose that a maximizer v of || Ax|| g /||x|| p has the properties that 

(i) all its nonzero components have the same absolute value, and 

(ii) the same is true of Av. 

If 1 < p < oo, or p = 1 and v G K\, or p = oo and v G K_\, then w is an eigenvector of 
the matrix A* A. 

Proof. Because of the duality relation (3.1), we have 

||AMv|| p . < ||A|| p> JAv||,. 

= (Pv|| g /||v|| p )Pv||^. 
It is easily seen from the property (ii) that 

\\Av\\l=\\Av\\ q \\Av\\ q *- 

Therefore 

v-A*Av= \\Av\\ q \\Av\\ q * > ||v|| p ||AMv|| p .. 

This shows that equality holds in the Holder inequality for the bilinear form v • A*Av in 
£ p x £ p *. If 1 < p < oo, this implies that the vector A* Aw must be a multiple of the vector 
with components llvHp 1-2 -^. (See, e.g., [HLP p. 26#14].) By Property (i) this vector is a 
multiple of v, which proves the result for this case. 

If p = 1 so that p* = oo, and if v has no zero component, it is easily seen that equality 
in Holder's inequality implies that A* Aw is proportional to the vector with components 
\vj\~ 1 Vj : and we reach the same conclusion. This is the case when p = 1 and v G K\. 

If p = oo so that p* = 1, one easily sees that equality in the Holder inequality implies 
that A* Aw has zero components where v does. Therefore, if v G -KT-i so that it has only 
one nonzero component, A* Aw is again proportional to v. 

Thus the Lemma is proved in all cases. 

Proof of Theorem 3. It is easily verified that || Axlloo/HxHi < p, the largest absolute 
value of any entry of A, and that this bound is attained when x is in the direction of a 
coordinate which corresponds to a column in which an element of magnitude p occurs. 
Thus ||^4||i,oo = Pi which is the first statement of the Theorem. 

Moreover, a unit coordinate vector v in the direction of a column which contains an 
element of magnitude p is a maximizer of the ratio. 

Suppose now that A G £i,oo(p, l)- Then equality in (1.5) holds for r = 1 and s = oo. 
Proposition 2 shows that if v is a unit vector in the direction of a column of A with a 
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maximal element, this column has exactly one nonzero element, and v is a maximizer of the 
ratio || Ax|| g /||x|| p . The first of these properties says that any column of A which contains 
an element of magnitude p has but one nonzero element, while the second property implies 
that the absolute value p of the nonzero element equals ||-A|| Pj9 = ||A||i )00 . There may, of 
course, be several maximizers, and therefore several columns with singleton elements of 
magnitude p. 

Since v and Aw are both in coordinate directions and p > 1, we can apply Lemma 3.2 
to show that v is an eigenvector of A* A. Therefore if x is a coordinate vector orthogonal to 
v, it is also orthogonal to A* Aw, which implies that Ax is orthogonal to Aw. This means 
that a column which contains a single nonzero element of magnitude p is orthogonal to 
all the other columns of A. In other words, an element of magnitude p is also the only 
nonzero element of its row as well as of its column, so that Property (i) is established. 

If we choose a trial vector x whose components in the directions of the columns with 
elements of magnitude p are zero, then Ax = Cx where C is defined in the statement of 
Theorem 1. Therefore ||C|| p , g < \\A\\ p , q = p. This is Property (ii). 

To prove the converse statement for p < q, we define B = A — C, and decompose any 
vector x into y + z, where the components of z are zero in the directions corresponding to 
columns which contain elements of magnitude p and the components of y in the remaining 
directions vanish. Then by Property (i) and two applications of Proposition 1 

Px||, = {(p||y||^+||Cz||^ 

< {(p\\y\\ P ) q + m\ P ,M\ P ) q } 1/q 

< {( P \\y\\ P ) p + m\ P ,M\ P ) p } 1/p 

< max{p, ||C|| Pi J||x||p. 

That is, 

(3.2) \\A\\ Ptq = max{p, ||C|| P , J. 

Thus Property (ii) shows that ||A|| Pjg = p = \\A\\i ;00 , and the proof of the converse state- 
ment is complete. 

To prove the last assertion of Theorem 3 assume that p > q and that A e £i,oo(P) <?)• 
Choose a trial vector x whose component in the direction of a column with a singleton 
element of magnitude p is one and which has one other nonzero component a. Let b be 
any entry of A in the column which corresponds to a. Then because p > q, 

IUxlls >^^ + (i/ f )rtiw + .(i«n 



|X|| p 



for small a. Because p = \\A\\ Pjq , the right-hand side must be bounded by p, and we 
conclude that 6 = 0. Because b is an arbitrary element of any column other than that with 
the entry of magnitude p, we conclude that all other columns of A are zero, so that A has 
only one nonzero entry. 

Finally, a simple computation shows that if A has only one nonzero entry, and if the 
magnitude of this entry is p, then ||-A|| rjS = p for all r and s, so that A e £i,oo(p, <?)• 
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Thus all parts of Theorem 3 have been established. 

Because it is difficult to compute the p, q norm for most p and q, it is difficult to verify 
Property (ii) of Theorem 3. We shall show that the easily verified Property (i) is sufficient 
to assure the existence of some p > 1 and s < oo such that equality holds in (1.5) when 
r < p and s > q. 

Theorem 3'. Let A have Property (i) of Theorem 3. Let C be the matrix obtained 
from A by replacing all elements of absolute value p = \\A\\i t00 by 0, so that ||C||i )00 < p. 
If p and q satisfy the inequalities p < q and 

(3.3) m^^n^HCIlLoo^p, 

then A e £i,<x>(P) <?)• The inequality (3.3) is satisfied if p is sufficiently close to 1 and q is 
sufficiently large. 

Proof. Since (1.5) shows that 

IICII^^m^/rtn^HCIlLoo, 

the inequality (3.3) and the equation (3.2) imply that = p. That is, Property (ii) 

of Theorem 3 holds, and the conclusion A e £i,oo(P) o) follows. 

4. THE CLASSES £ h i(p,q) AND £oo i00 (p, q). 

Proof of Theorem 4. Suppose that A e £i,i(p, q), so that equality holds in (1.5) with 
r = s = 1. The triangle inequality shows that ||Ax||i/||x||i < cr, the largest l\ norm of the 
columns of A. Moreover, this bound is attained when x is in the direction of any coordinate 
whose corresponding column has the l\ norm a. Thus if v is a coordinate vector in such 
a direction, it is a maximizer for the ratio. 

Proposition 2 states that if v is a unit vector in one of these coordinate directions, the 
elements of the corresponding column Av must have equal absolute values, and v must 
also be a maximizer of || Ax|| g /||x|| p . These two facts give the properties (i) and (iii) of 
Theorem 3. 

Since p > 1, Lemma 3.1 shows that v is an eigenvector of A* A. As in the proof 
of Theorem 3, this implies that if x is a coordinate vector perpendicular to v, then it is 
also perpendicular to A*Av, so that the column Ax. is perpendicular to Av. This is the 
property (ii) 

To prove the converse statement, we observe that if A has a column whose elements 
have the absolute value n -1 / 9 !^^^, then a unit vector v in the direction of this column 
is a maximizer of the ratio || Ax|| g /||x|| p . Therefore the converse statement of Proposition 
2 implies that equality holds in (1.5), and hence that A e £i,i(p,q). 

To prove the last statement of Theorem 4, we suppose that A e £i^(p,q), and that 
p > 2. Then there is at least one column c of A all of whose entries have the absolute 
value n~ x a = rz — 1 / <? || A|| Pj9 . Let c be one such column, let b be any other column of A, 
and let a be a real parameter. The adjoint relation (3.1) leads to the inequality 

(4.1) \\A*(c + ab)|| p . < \\A\\ p Jc + ab\\ q * = n^+^VUc + ab\\ q *. 
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We observe that for small a 



\cj + ab j \ q * = \cj\ q * + q* Re(a|c j \ q *~ 2 Cjb 3 ) + 0(a 2 ). 

We sum on j and use the properties that the entries of c all have the absolute value n _1 a 
and that b is orthogonal to c to find that 

(4.2) || c + ab\\ q q l = n- 1+{1/q ^a + 0(a 2 ) = n~ 1/q a + 0(a 2 ). 

Since c and b are orthogonal, the entry of A*(c+ah) which corresponds to the column 
c is n -1 cr 2 , while the entry which corresponds to the column b is || t>|| 2 - W e obtain a 
lower bound for the left-hand side of (4.1) by replacing all the other entries by zero. For 
small a this lower bound takes the form 

\\A*(c + ab) || p , > n" V + (?T V~ V 2 ) 1 -^ ||b||^V* + 0(a 2p *). 

where K > 0. 

By putting this and (4.2) into (4.1), we find the inequality 

ra - V + ^yi^-i^i-v* ||b||* p V* + 0(a 2p *) < n~ l a 2 + 0(a 2 ). 

We observe that p* < 2 because p > 2. We cancel the first terms from the two sides, divide 
by a p , and let a approach zero to see that ||b|| 2 = 0. That is, every column other than c 
is zero. This establishes the last statement of Theorem 4, and the Theorem is proved. 

Theorem 5 will follow easily from Theorem 4 and the following lemma. 

Lemma 4.1. If equality holds in (1.5), then equality also holds when A is replaced 
by A* , the pair (r, s) is replaced by (s*, r*), and the pair (p, q) is replaced by (q*,p*)- 

Proof. We recall the adjoint equation (3.1), namely ||A*|| 9 * jP * = We also 

note that in going from A to A* the dimensions m and n are interchanged, and that by 
definition (1/q*) - (1/s*) = (1/s) - (1/q) and (1/r*) - (1/p*) = (l/p) - (1/r). Therefore, 
the replacements indicated in the Lemma leave both sides of (1.5) unchanged, which proves 
the Lemma. 

Proof of Theorem 5. By Lemma 4.1, A e £oo,oo(p, q) if and only if A* e £\^{q* , p*). 
Since s > q implies s* < q* and r > p implies r* < p*, the application of Theorem 4 to A* 
with the above index replacements gives the statement of Theorem 5. 

As in the case of Theorem 3, it is difficult to verify the last hypothesis of Theorem 
4. We shall prove that the easily verified Properties (i) and (ii) are sufficient to assure the 
existence of p, q G (1, 00] such that A G £1,1 (p, q) 

Theorem 4'. Let A have the Properties (i) and (ii) of Theorem 4. Let C be the 
matrix obtained from A by replacing all columns with the l\ norm a = ||^4||i,i by zero, so 
that 1 1 C 1 1 1 , 1 < cr. If p < 2 satisfies the inequality 

^mn^-^a"^^!!'? + p 1 "^) - 1] 
1 '"^ • [(p/2) 1 /( 2 -P)n(- 3 P 2+2 P+ 4 )/[ 2 ^ 2 -^m- 2 ^- 1 V( 2 -p)(||C'|| 1 , 1 /a) 2 /( 2 -^] < 1, 
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and q < p, then A e £i j \(p,q). The inequality (4.3) is satisfied when p is sufficiently near 
1. 

Proof of Theorem 4'. We recall that C is the matrix obtained from A by replacing 
those columns whose l\ norm is a by 0. Thus ||C|| i ; i < a. Let B = A — C, so that all the 
nonzero elements of B have the magnitude n _1 cr, and every column of B is orthogonal to 
all other columns of A. To establish the Theorem, we only need to show that the inequality 

(4.3) implies that \\A\\ P , P = n - 1+ ^<r = n~ 1+ ^ \\A\\ 1A . 

Decompose an arbitrary vector x ^ into x = y + z, where z is obtained from x 
by replacing those elements which correspond to the nonzero columns of B by zero, and 
y = x - z. 

We see from the conditions (i) and (ii) of Theorem 4 that for the above decomposition 
x = y + z, 

(4.4) ||Sx||l = n-V 2 ||y|||. 

In particular, ||-B||2,2 = n _1 / 2 a, so that B satisfies the conditions of Theorem 3 with 
p = q = 2. Therefore, 

(4.5) ||S|| ria = n- 1+ ^(7 

for all r and s in the interval [1,2]. On the other hand, the inequality (1.5) shows that 

(4.6) ||C|| r ,.<m 1 -( 1 /')||C7|| 1 , 1 . 

for r, s > 1. Therefore if p < 2, the triangle inequality shows that 

(4.7) l|Ax:|| p <n- 1+ ^V||y|| p + m 1 -^||C||i,i||z|| 1 ,. 
Proposition 2 shows that 

(4-8) ||x|| p = (||y|g + ||z||^)^ > 2- 1 +( 1 ^(||v|| p + ||z|| p ) . 

We see from (4.7) and (4.8) that 

(4.9) < n~ 1+ ^a 



whenever 



l-(2mn) 1 -( 1 /p) (J -i||C||0 



(4-10) ||y|| P < ai-d/p),! H Z II P - 

Thus the bound (4.4) is valid when the ratio ||y||p/||z|| p is not too large. To obtain 
this bound for larger values of this ratio, we note that 

n 

(4.11) \\A*\\* = J2(\(By)j\ 2 + 2Re[(B^T j (Cz) j ] + {(Cz)^. 

i=i 
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Because p < 2, the function w p l 2 is concave, so that for any positive d and w 

w p/2 < d p/2 + ( p /2)d W2) - 1 (w - d). 

We apply this inequality with d = n~ x ||-By||i to each term of the sum on the right of (4.11) 
and use the fact that the range of C is orthogonal to the range of B to see that 

(4.12) \\Ax\\» < ^-^HSyll^ + (p/2)n 1 -^\\By\\P- 2 \\Cz\\l 

The equation (4.5) shows that the first term on the right is bounded by 
n~ 1+ ( l / p \a\\y\\ p ) p . Therefore we see that the inequality (4.9) is valid when 

(4.13) (p/^^-^HBylir'llCzlll < n"-V||z||J. 

We see from (4.6) that ||Cz|| 2 < m 1 "^ ||C||i,i||z|| p , and from (4.4) and (1.4) that 

||Sy|| 2 = n- 1 /V||y|| 2 >n- 1 /V||y|| p . 
Therefore the inequality (4.13), and hence also (4.9), is implied by 

(4.14) ||y|| p > (p/2)V(2-^)^(-3p 2 +2 P +4)/[2 P (2-p)3^-2(^-l)/ C 2-^) ( || (:7 ||^ i/ ^ ) 2/(2-p) | | z |^_ 

We now observe that the inequality (4.3) states that the coefficient on the right of 
(4.14) is no larger than that in (4.10). Therefore at least one of these inequalities inequal- 
ities is satisfied for every y and z. That is, the inequality (4.9) holds for all x, so that 
||^4|Ip,p < n _1+1 / p (j = n _1+1 / p ||A||i ! i. Because (1.5) gives the inequality in the opposite 
direction, we conclude that A e £i,i(p,p), and hence also that A e £i,i(p, q) for any q < p. 
Thus Theorem 4' is established. 

By using Lemma 4.1 and applying Theorem 4' to A* , we obtain the analogous result. 

Theorem 5'. Let A have the Properties (i) and (ii) of Theorem 5. Let C be the 
matrix obtained from A by replacing all rows with the i\ norm a = \\A\\i t i by zero, so that 
|| C\\i i < a. If q > 2 satisfies the inequality 
(4.15) 

(2mn) 1 /V- 1 ||C|| 1 + [2 1 /'?-l] 

• [( ? 72)V(2-^) m (-3(gn 2 +2 g *+4)/[2 g *(2- g *)] n -2( g *-l)/(2^ P ) ( || C || iii/a) 2/(2- g *) ] < ^ 

and p > q, then A e £<x>,oo(p> The inequality (4.15) is satisfied when q is sufficiently 
large. 

5. THE CLASS 5oo,i(p»?)- 

Proof of Theorem 6. Suppose that A e £oo,i(p, q)- Proposition 2 shows that every 
maximizing vector v of the ratio || Axlli/HxH^ has the properties (ii) its components have 
equal absolute values, which we normalize to 1; (iii) the components of Av have equal 
absolute values, which we call r; and (iv) || Av|| 9 /||v|| p = ||A|| Pj g. Because p < oo, Lemma 
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3.1 shows that v is an eigenvector of A* A, which is Property (i). Thus the first part of 
Theorem 6 is proved. 

On the other hand, a vector v with the properties (ii), (iii), and (iv) is a maximizer 
of the ratio || Ax|| g /||x|| p , so that Proposition 2 also establishes the converse statement. 

The last statement of Theorem 6 clearly follows from the rest when p = q = 2, so the 
Theorem is proved. 

We are unable to find an analog of Theorems 3', 4', and 5' for this case. We confine 
ourselves to the following simple observations. 

1. If we define V to be the diagonal unitary matrix whose diagonal entries are the 
components of v and D to be the diagonal unitary matrix whose diagonal entries are the 
components of the vector r _1 Av, the conditions of Theorem 4 imply that all the row sums 
of the matrix DAV are r and that all its column sums are m _1 nr. Conversely, if one can 
find two matrices D and V with these properties, then the vector v whose components are 
the diagonal entries of V has the properties (i), (ii), and (iii) of Theorem 4. Thus equality 
holds in (1.5) for r > p and s < q if and only if there are matrices D and V with these 
properties and r = m 1 / p n~ 1 / q \\ A\\ P:q . 

2. A sufficient condition for A G £oo,i(2, 2) is that there exist diagonal unitary matrices 
D and V such that the matrix DAV has nonnegative entries, equal row sums, and equal 
column sums. When m = n, DAV is a multiple of a doubly stochastic matrix. 

3. The matrices with a single nonzero element which occur in the last statement of 
Theorem 3 can be thought of as the tensor product of two vectors in K_\. Similarly, 
the matrices in the last statements of Theorems 4 and 5 are tensor products. It is easily 
verified that if A = c <g> b so that its entries have the form Cibj, then ||^4|| r ,s = ||b|| r * || c l|s- 
Then Proposition 1 shows that when A = c <g> b, equality holds in (1.5) if and only if 
a G -ftT_ sgn ( p _ r ) and c G ^sgn(g-s)- 

Theorem 6 and the fact that ||A||i j00 = p show that A G £oo,i(p, q) for all p G [1, oo) 
and q G (1, oo] if and only if A is the tensor product of two vectors in K\. 

REFERENCES 

[GVL] Gene H. Golub and Charles F. Van Loan, Matrix Computations, Johns Hopkins 
U. Press, 1983. 

[H] N. J. Higham, Accuracy and Stability of Numerical Algorithms, SIAM 1996. 
[HJ] R. A. Horn and Charles R. Johnson, Matrix Analysis, Cambridge, 1985. 
[HLP] G. H. Hardy, J. E. Littlewood, and G. Polya, Inequalities, Cambridge, 1952. 

[SS] H. Schneider and G. A. Strang, Comparison theorems for supremum 
norms, Numer. Math. 4:15-20, 1962. 



13 



